Dialogue Scenes Detection in MPEG Movies: A Multi-expert Approach
نویسندگان
چکیده
In this paper we propose a method for the detection of dialogue scenes within movies. This task is of particular interest given the special semantic role played by dialogue based scenes in the most part of movies. The proposed approach firstly operates the segmentation of the video footage in shots, then each shot is classified as dialogue or not-dialogue by a Multi-Expert System (MES) and, finally, the individuated sequences of dialogue shots are aggregated in dialogue scenes by means of a suitable algorithm. The MES integrates three experts which consider different and complementary aspects of the same decision problem, so that the combination of the single decisions provides a performance that is better than that of any single expert. While the general approach of multiple experts is not new, its application to this specific problem is interesting and novel and the obtained results are encouraging.
منابع مشابه
Automatic Cut Detection in MPEG Movies: A Multi-expert Approach
In this paper we propose a method to detect abrupt shot changes in MPEG coded videos that operates directly on the compressed domain by using a Multi-Expert approach. Generally, costly analysis for addressing the weakness of a single expert for abrupt shot change detection and the consequent modifications would produce only slight performance improvements. Hence, after a careful analysis of the...
متن کاملA Framework for Dialogue Detection in Movies
In this paper, we investigate a novel framework for dialogue detection that is based on indicator functions. An indicator function defines that a particular actor is present at each time instant. Two dialogue detection rules are developed and assessed. The first rule relies on the value of the cross-correlation function at zero time lag that is compared to a threshold. The second rule is based ...
متن کاملMovie Scene Classification Using Hidden Markov Model
Movie is a kind of complex video with rich content. The analysis of movie is more complicated than other types of videos like surveillance, sport games, and documentaries. In this paper, a statistical approach using hidden Markov model to classify movie scenes is proposed. Two important kinds of movie scenes, dialogue and fighting scenes, are classified. Color and motion features are extracted ...
متن کاملMultimodal and ontology-based fusion approaches of audio and visual processing for violence detection in movies
In this paper we present our research results towards the detection of violent scenes in movies, employing advanced fusion methodologies, based on learning, knowledge representation and reasoning. Towards this goal, a multi-step approach is followed: initially, automated audio and visual analysis is performed to extract audio and visual cues. Then, two different fusion approaches are deployed: ...
متن کاملAutomatic Violence Scenes Detection: A multi-modal approach
In this working note, we propose a set of features and a classification scheme for detecting automatically violent scenes in movies. The features are extracted from audio, video, and subtitles modalities of the movies. In violent scenes classification, we found the following features relevant: the short time audio energy, motion component, and shot words rate. We classified the shots into viole...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2001